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ASYMPTOTICS OF THE PROBABILITY MINIMIZING 
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By Hiroaki Hata, Hideo Nagai 1 and Shuenn-Jyi Sheu 2 

Academia Sinica, Osaka University and Academia Sinica 

We consider a long-term optimal investment problem where an 
investor tries to minimize the probability of falling below a target 
growth rate. From a mathematical viewpoint, this is a large devi- 
ation control problem. This problem will be shown to relate to a 
risk-sensitive stochastic control problem for a sufficiently large time 
horizon. Indeed, in our theorem we state a duality in the relation 
between the above two problems. Furthermore, under a multidimen- 
sional linear Gaussian model we obtain explicit solutions for the pri- 
mal problem. 

1. Introduction. In recent studies of finance, it has been of great concern 
to consider problems from risk management. In this paper, we consider the 
problem of the control of a down-side risk probability for an investor. To 
minimize such probabilities and obtain an optimal (or nearly optimal) port- 
folio, we relate the problem of the portfolio optimization with risk sensitive 
criterion. In [35, 36], from the consideration of a performance index for funds 
when compared to a benchmark, a similar problem is considered. In [30, 31], 
problems of maximizing the up-side chance probability are studied. These 
studies show potential applications of risk-sensitive dynamic management 
to the problem of risk management. 

Portfolio optimization with risk-sensitive criterion has been considered in 
several recent works (see [2-4, 7, 10, 14-16, 18, 19, 21, 25, 28] and [29]). 
The problem is to maximize the expected utility of terminal wealth with the 
HARA utility function being considered, 

i(X£)T 



1.1) max E 
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where Xf is the wealth process using strategy ir, and the maximum is taken 
over a class of admissible strategies. In the following discussion, it is also 
convenient to replace (1.1) by 

(1.1a) max{E[(X£y]}, 7 > 0, 

and 

(1.1b) mm{E[(X$p]}, 7 < 0. 

The parameter 7 is taken from (—00, 1) and for 7 = 0, i(AJ) 7 is interpreted 
as logXJf which is a Kelly utility. When the HARA utility is used, the 
problem can be reformulated as a risk-sensitive control problem where 7 
plays the role of risk-sensitive parameter. Then methods from the theory of 
stochastic control can be applied to the portfolio optimization problem. In 
particular, we may apply dynamic programming to solve the problem. This 
approach is very useful in discrete time models (see [24] for some idea). In 
continuous time, we need to solve the Bellman equation. In the past few 
years, a special class of models has been extensively studied in this frame 
work where a factor process is introduced and the return, together with the 
volatility of stock prices, is affected by the factor process. That is, we assume 
in a market that we have one bank account with price Sf, m stocks with 
prices S|, i = 1, . . . , m, and n economic factors Y t = (Y/, Y t 2 , . . . , Y t n ). Their 
dynamics are given by 

(1.2) dS° = r(Y t )S?dt, S ° = s°, 



n+m 



(1.3) dS\ = SH a\Y t ) dt+J2 4(Yt) dW t k \, S\0) = s\i = l,..., 



in. 



k=l 



(1.4) dY t = P(Y t )dt + \(Y t )dWt, Y(0) = yeR n , 

where Wt = (Wt)k=i,...,(n+m) is an ( n + m ) -dimensional standard Brownian 
motion defined on a filtered probability space (f2, P, Tt). A closed form 
optimal strategy may be obtained by solving the Bellman equation. See 
[10] for the initial study and the subsequence works cited above. For an 
introduction of the theory of the risk-sensitive control problem, one can see 
[37]. For the mathematical theory of the risk-sensitive control problem and 
the connection with the robust control problem, one can see [11, 12, 17, 27]. 

Bielecki and Pliska ([2], Section 6) mention a possible use of portfolio 
optimization with risk-sensitive criterion in the study of the problem of up- 
side chance and down-side risk. The problem of up-side chance is to consider 

(1.5) maxlp(-logX%>c 
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for large T where the maximization is taken for tt in a class of admissible 
strategies. Or more generally, 



where It is a benchmark process. For simplicity, we take It = 1 in the fol- 
lowing discussion. A mathematical theory was developed in [30] and [31] for 
the maximization of the up-side chance probabilities. It is shown that the 
probabilities in (1.5) are related to those in (1.1) with < 7 < 1 through a 
duality relation. A nearly optimal portfolio for (1.5) can be obtained from an 
optimal portfolio for (1.1) for a particular chosen 7. Some idea from large de- 
viation theory is implicitly used in his approach. This will be described later 
in this section. Interestingly, the maximization of the probability of up-side 
chance is not a conventional optimization problem and, in general, is difficult 
to treat. Therefore, studies in [30, 31] suggest the possibility of indirectly us- 
ing the theory of stochastic control in such a nonconventional optimization 
problem. See also [19] for more studies on this problem. However, Sekine 
[33] recently tried to use a duality approach to treat such problems. In [30], 
Pham also proposed to develop a mathematical theory for the down-side 
risk probability, 



The problem is to minimize (1.6) and obtain an optimal (or nearly optimal) 
portfolio. Here k is considered such that the event has small probabilities. 
Hence we are dealing with a rare event. From the consideration of finance, 
such rare events in down-side risk are not favorable to an investor. Therefore 
its occurrence may result in a significant consequence in portfolio manage- 
ment. Hence the study of (1.7) or (1.8) may be of meaningful implications 
in finance. See interesting discussions in [5, 6] and [35, 36] for some related 
problems where the consideration is the performance index for funds. In this 
paper, we develop some mathematical analyses for (1.7). Similar to [30, 31], 
we will show a dual relation between (1.1) and (1.7) for large T. The result 
says that for k, there is a correspondence j(k) < such that an optimal 
portfolio of (1.1) with 7 = j(k) is a nearly optimal portfolio of (1.7). The 
meaning of this result is that an investor who wants to control (1.7) for a 
particular k will have the same behavior as an investor whose risk parameter 
is j(k). See a similar result in [36] for some discrete time models. 



(1.6) 




(1.7) 




or more generally, 



(1.8) 
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In this paper we consider only the linear Gaussian models. But our method 
may be applied to more general (nonlinear) models. Gaussian models have 
practical uses for practitioners. A simple Gaussian factor model was first 
proposed in [26]. Such models have several important properties. It is much 
easier to estimate the coefficients by using linear regression (see [32]). This 
has practical applications. Tractibility is another big advantage of these 
models. For such models, a closed-form solution for the optimal portfolio 
selection problem (1.1) is possible by solving a Ricatti equation, which is 
a matrix equation and is easier to solve [[2, 3], [14-16, 25]]. For Gaussian 
models, we have some finer mathematical results [25]. In the later sections, 
we will see that these results will be crucial for our analysis. It is important 
to consider the model when some factors cannot be observed directly. The 
solution is far away from complete. One can find some results for linear 
Gaussian models in [18, 29, 34]. However, this is not our main concern in 
this paper. 

The papers [30, 31] (and also this paper) consider (1.5) [and (1.7), respec- 
tively] for such c (and k) that (1.5) [and (1.7)] has small probability. That 
is, we are dealing with large deviation probabilities. Therefore, we expect 
that some idea from large deviation theory can be used to relate (1.1) and 
(1.5) [or (1.7)] that we now explain. The formal calculation given in the 
following may be instructive to see the idea. For a given strategy n, assume 
Zt = logXJ satisfies a large deviation principle with rate I(k, it). Formally, 
this means 



If we want to minimize $(7, 7r) [and minimize I(k,ir)] over ir, then 




as T 00. The Laplace- Varadhan lemma (see [8]) implies 



E[(X%y*] = £[exp( 7 logX?)] ~ exp(T<I>(7,7r)) 



where 



$(7, 7r) = sup{7& + I(k, 71")}. 



A' 



(1.9) 




TT 



TT 



k 



Denote 



J(k) 



inf {/(£;, vr)}, 

7T 

inf{$( 7 ,7r)}. 



d>( 7 ) 



7T 
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If we are allowed to change the order of inf and sup on the right-hand side 
of (1.9), then we obtain 



(1.10) 



$(7) = sup{7& + J(k)}. 

k 



If J(k) is a concave function, then we expect to have the dual relation 



(1.11) 



J(k) = inf {$(7) - 7/c} 



(see [9]). On the other hand, if we want to maximize $(7, 7r) [and maximize 
I(k,ir)] over possible it, then 



(1.12) 
Denote 



sup<I > (7, 7r) = supsup{7A; + I(k, tt)}. 

7T 7T k 



I(k) = SUp{/(fc, 7r)}, 

¥(7) =sup{$( 7 ,7r)}. 



Then 



$(7) = sup{7/c + /(/c)}. 

k 



If /(A;) is concave function, then we expect to have the dual relation, 

I(k) = inf {¥(7) - 7B. 

7 

In [30, 31], through the above intuition, the following relation was proved: 



where, for large T, 



H(c)= inf {*(7)-7c}, 

0<7<1 



value of (1.1) ~ -exp(T*(7)), 

7 



value of (1.5) ~ exp(Tn(c)). 
On the other hand, one of the main results of our paper is to prove 



where, for large T, 



n(fc) = mf{*(7)-7fc}, 

7<0 



value of (1.7) ~ exp(TII(fc)). 
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The problem analyzed here is closely related to the problem studied in 
[30, 31], since 



However, in both studies we are interested in the region of c and k such 
that probabilities in (1.5) and (1.7) are small. This means in this paper we 
study the region of c such that (1.5) has large probability while in [30, 31], 
it is studied in the region of c that (1.5) has small probability. This explains 
why the results of [30, 31] cannot be readily applied to the calculation of the 
down-side risk probabilities. We consider both of the problems for large T. 
We show in this paper that the minimization of (1.7) relates to the problem 
(1.1) for 7 < 0. However, the probability in (1.5) relates to problem (1.1) 
for < 7 < 1 as was shown in [30] . We will show that an optimal (or nearly 
optimal) portfolio for (1.7) can be derived from an optimal portfolio of (1.1) 
for a proper chosen 7 < that relates to k through the duality relation. 
This is expected, after [30, 31]. However, our result does not follow from a 
simple Markov inequality as in [30, 31]. We need to use some finer results 
for (1.1), taken from [25] and some extensions given in Section 2 later. This 
is unexpected from the argument in [30, 31] and is also unexpected from the 
large deviation theory. Intuitively, when changing the order of inf and sup 
in (1.9) to obtain (1.10), it may cause some difficulty. Mathematically, we 
also want to mention another important point. The convexity of the value 
of (1.1b) with respect to 7 after taking limit for large T will be crucial in 
our analysis. We note that the convexity of (1.1b) does not follow for finite 
T. This property is easily seen for (1.1a) from our formal derivation given 
in the previous paragraph, since taking the maximum of a family of convex 
functions is a convex function. 

The paper is organized as follows. In Section 2, the model will be explicitly 
stated and the mathematical problem of down-side risk will be formulated. 
The associated problems of portfolio optimization will also be described. 
Since the problem has different formulations in an infinite time horizon, 
we will careful state our problem. We also give some remarks to mention 
other related problems. The main results will be stated in this section. These 
include the main theorem (Theorem 2.1), and several important propositions 
(Propositions 2.1-2.7). The results are presented in a way that a proof of 
Theorem 2.1 will follow using mainly results in the propositions and some 
minor properties. The proof of our main theorem also suggests that our main 
result will follow when we can prove the statements given in several crucial 
propositions. Therefore, the approach in this paper can be applied to more 
general models (including some nonlinear models). The problem for some 
nonlinear models is currently under investigation. 
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In Section 3, we give the proof of our main theorem. In Section 4, we 
prove the propositions stated in Section 2. These propositions concern the 
portfolio optimization problem (1.1) and the behaviors of the solution of the 
Bellman equation. Some results in these propositions have been obtained in 
[25]. They include Propositions 2.1, 2.2 and 2.3. Therefore, in the proof of 
these results, we give a sketch or modification of the arguments in [25] and 
mention the places in [25] where one can find the details of analysis used. 
Propositions 2.4, 2.5, 2.6 and 2.7 are some new results that are suggested 
by the problem studied in this paper. Therefore, some more details of the 
proofs will be given for these propositions. 

2. The problem and main results. 

2.1. Down-side risk problem. We consider a market model consisting of 
one bank account and m risky stocks. The interest rate of bank account as 
well as the returns and volatility of stocks are affected by n economic factors. 
The price of bank account S° and the price of risky stocks S l , i = 1, . . . , m, 
are given by 

(2.1) dS? = r(Y t )S°dt, S° = s°, 

{n+m ^ 
a l {Y t ) dt + £ 4(Xt) dW t k \ , S*(0) = s\ i = 1, . . . , m, 

where Wt = iWt)k=i,...,(n+m) is an ( n + m ) -dimensional standard Brown- 
ian motion process defined on a filtered probability space (f^T 7 , P, J-i). The 
factor process Yt with n components is described by 

(2.3) dY t = (3(Y t )dt + \(Y t )dW t , Y(0) = yeR n . 

In this paper we assume that r(y),a(y),a(y), f3(y) and X(y) are given by 
r(y) :=r, 

(2.4) a(y):=a + Ay, a(y) := E, 
(3(y):=b + By and X(y) := A 

with constants r > 0, a € W 71 and b G W 1 . Moreover, A,B,H,A are m x n, 
n x n, m x (n + m), n x (n + m) constant matrices, respectively. In this 
paper, we assume the following conditions (A): 



(Al) 
(A2) 



££* > 0, 
G:=B- AS^SS*)" 1 ^ is stable. 
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Remark 2.1. The matrix G is stable if the real parts of its eigenvalues 
are negative. 

Consider an investor who invests at time t a proportion ir\ of his wealth 
in the zth risky stock S l , i = 1, . . . , m. With irt = (tt}, ■ . ■ , vr^ 1 )* chosen, the 
proportion of wealth invested in the bank account is 1 — tt^I where (•)* 
denotes the transpose of a vector or a matrix. Here 1 = (1,...,1)*. We allow 
short selling (7r| < for some i) or borrowing (1 — ir*l < 0). 

We assume the self-financing condition. Then the investor's wealth, X£ , 
starting with the initial capital x satisfies the equation 

dX^ . # . dS® ^-~\ j dS\ 
{ ~Xf = ^~^ 1) ^f + ^ £p 
X* = x. 



This equation can be solved and we have 
X£ = x exp 



(2.6) 



J ir+(a + AY t -rl)*n t 



1 



-7r t *ES*7r t }dt+ I nl^dWt 



T 







For a finite T and given target growth rate k, we shall consider the proba- 
bility of minimizing the "down-side" risk, 

(2.7) inf P ( l ^<k 

where At is the set of all admissible investment strategies which will be 
prescribed in Section 2 [see (2.31)]. Here, the investor is interested in mini- 
mizing the probability that his wealth falls below a target growth rate. We 
will be mainly concerned with the large T asymptotics. That is, 

(2.8) II(fc) := hm i inf logpf < k 

We shall calculate H(k). Connecting to this, we will obtain a (nearly) optimal 
strategy for (2.7) for large T. 

2.2. Portfolio optimization problem. Since it is difficult to directly calcu- 
late (2.7) and (2.8), in order to solve our problem we need to introduce the 
following portfolio optimization problem of maximizing the expected utility. 
For 7 < 0, we consider 

sup e(-(X^ 



■k&At \7 
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This is the same as 

(2.9) inf E{{X^). 
The large T asymptotics are given by 

(2.10) ¥( 7 ):= lim i inf \ogE{X T )\ 7 < 0. 
For (2.9), we define 

(2.11) J(x,y,ir;T):=x-iE(XZy, 

where Xq = x,Yq = y, and tt is taken from the set At- At will be defined 
in (2.31). We then define 

(2.12) v(t,y)= inf log J(x,y,n;T - 1), 7 < 0. 



T 

7 <j>(Y t ,-K t )dt)t T 



Using (2.6), we have 

J(x,y,Tr;T) = E^ex.p^J 
where 4>(y,p) is defined by 

(2.13) <f>(y,p) := r + (a(y) - rl)*p - I^Vs£*p 
and 

(2.14) Cf = expQ%<EdWt - i £"?\E** t \ 2 dt\ . 
If we assume 

(2.15) £(C?) = 1, 
then by Girsanov theorem, we have 

(2.16) J(x, y, tt; T) = EF (exp (J^ 7 0(F t , vr t ) ) , 

where £/""(•) is the expectation with respect to the probability measure P* 
defined by 

dP w 

< 2 ' 17 > %r 

We can rewrite the equation for Yj as 
(2.18) dY t = p(Y t ,Tr t )dt + AdW 7T (t), 



= Ct- 
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(2.20) 
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/%,7r) = /%) + 7 A£*7r 



W? = W t 



7E*7Ts ds. 



Wt is a (n + Tridimensional Brownian motion under P n . (2.9) becomes a 
stochastic control problem with criterion log J(x, y, it; T) [given in (2.16)], 
(2.18) is the state dynamic and nt is the control process. Here we note that 
J(x,y,7T]T) is not dependent on x. Therefore the value function is given by 
v(0,y) [and v(t,y) for the problem in (2.12)]. Then, by Bellman's dynamic 
programming principle, v should satisfy the following Bellman equation: 

r)v ( 1 

+ inf <^ - tr(AA*D 2 v) + (/? + 7 AE*7r)*Dv 



dt 



Trelt 



+ ^(Dv)*kh*Dv + 1 <t>{-,Tt) 



0, 



U(T,y) = 0, 
or, equivalently, 



(2.21) 



Ov 
dt 



+ -tr(AA*D 2 t;) + <'/3 + ^^AE*(SS*)- 1 (a-rl) } Dv 



1 



+ \{Dv)*A{l + 



1 



1-7 



+ 



7 



1-7 

(a - rl)*(EE*) -1 (a - rl) + 7 r = 0, 



2(1-7) 
U(T,y) = 

(see Section VI. 8 [17]). Actually, given a solution v(t, y) of (2.21), under some 
suitable conditions, % defined below gives an optimal strategy of (2.9): 

7T t :=7?(t,lf), 

(2.22) 

n(t,y) := — ^ — (EY,*)(y)~ 1 (a(y) — rl + HA* Dv(t,y)) 
1-7 

(see [17, 28]). Moreover, in relation to (2.10) we shall consider the ergodic 
type Bellman equation which is the limiting equation of the above Bellman 
equation, 



1 



X = inf { - tr(AA*£> 2 £) + (/3 + 7 A£*7r)* J D£ 



,7T 
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or, equivalently, 



X = \ tr(AA*Z> 2 e) + ip + Aj 



(2.23) + -(flO'A J + — i— £*(£E*) -1 I! U*Df 

2 [ 1-7 J 

+ 2(T^) ( ° " ^H^TV - rl) + 7T. 



Remark 2.2. The portfolio optimization problem in an infinite time 
horizon is closely connected with (2.10). On an infinite time horizon the 
criterion to be minimized is 

lim hogE{X$p, 

T^oo 1 

it € A, A is a class of admissible strategies. The problem is to calculate the 
value 

(2.24) inf hm ^log£(Xf) 7 

and obtain an optimal strategy. The Bellman equation for (2.24) is also given 
by (2.23). Connecting with (2.24), we may consider the minimization of the 
"down-side" risk probabilities in an infinite time horizon, 

(2.25) inf ; hm llogpf^^ <k 

There are some more mathematical difficulties that arise from the problems 
in an infinite time horizon. Some further discussion for this problem will be 
given after we state our main theorem (Theorem 2.1). 

2.3. Main results. The main idea of a stochastic control method for (2.9) 
or (2.10) is to solve the equations (2.21) or (2.23). From this, we can obtain 
the value in (2.9) or (2.10). We may also obtain an optimal strategy for (2.9) 
from the solution of (2.21). We state in this subsection the relevant results. 
Theorem 2.1 is our main result which also shows the connection between the 
problems (2.8) and (2.9) [or (2.10)]. Some propositions are given that will 
be used to prove Theorem 2.1. 

Proposition 2.1 [25]. Assume (Al) and 7 < 0. Then (2.21) has a so- 
lution given by 

(2.26) v(t, y) = \y*P{t)y + q(t)*y + h(t), 
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where P(t) satisfies the Riccati differential equation: 
(2.27) 



f P(t) + P(t)AN~ 1 A*P(t) + K{P{t) + P(t)Kx - C*C = 0, 
1 P(T) = 0, 



where 



(2.28) 



AT 



1 + — ^— S^SS*)" 1 ^ }> > 0, 
1 — 7 



7 



ATi := B + ^^AS^SS*)- 1 ^, 
1-7 



7 



-E*(EE*)-M, 



1-7 

and q(t),h(t) satisfy the equations 

( q(t) + {K x + AN- 1 A*P(t))*q(t) + P(t)b 

(2.29) 



+ — — (A* + P(t)AE*)(EE*) _1 (a - rl) = 0, 
1-7 



U(T) = 0, 

fc(t) + itr(AA*P(t)) + i g (i)*AA*g(t) + &*?(*) + 7 r 



(2.30) 



+ 



7 



-(a-rl + EA*g(t))*(SE*) 



2(1-7) 

x (a-rl + EA*g(t)) = 0, 
U(T) = 0. 



The proof can be found in [25]. We will give some remarks in Section 4.1. 
We now define the class of admissible investment strategies, At, 



(2.31) 



A T ■= < (K t )te[o,T\] 



E 



s(J [{P{s)Y s + q{s))*A + 1 nmdW, 



1 . 



This class of admissible strategies is also used in [25]. Here we use the no- 
tation, £{Z) := (£(Z)t)te[o,T]i f° r the stochastic exponential of a continuous 
semimartingale Z:£(Z)t := e z t~ l / 2 { z )t . Therefore, Q T in (2.14) is equal to 
£(J 77r*E dW)T- 

PROPOSITION 2.2 [25]. Assume (Al) and 7 < 0. Let P(t),q(t),h(t) be 
defined as in Proposition 2.1. Then the following defines an admissible strat- 
egy: 

9(t):=n(t,Y t ), 
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(2.32) 

7r(t,y) = -^—(^)- 1 [a -rl + EA*q(t) + {A + SA*P(i)}y] 
1-7 

and is optimal for the problem (2.9). Moreover, 

v(0,y) = y*P(0)y + q(0)*y + h(0). 

The proofs of Proposition 2.2 can be found in [25]. Some remarks will also 
be given in Section 4.1. 

In the following, notation v(t, y; T),P(t; T),q(t; T),h(t; T) will be used for 
the dependence of P(t),q(t),h(t) on T. Similarly, we use 

v(t,y;T;i), P(t;T; 7 ), g(t;T; 7 ), h(t; T; 7), 

if we need to discuss the dependence of the functions on 7. 

We now consider (2.10). We consider a solution of (2.23) that is quadratic 
in y. That is, 

(2.33) ^y)--=h*Py + q*y, 

where P is a symmetric n x n matrix, and q is a vector in M n . P and q will 
satisfy the equations: 

(2.34) KlP + PK 1 + PAN^ 1 A*P-C*C = 0, 
(K 1 + AN~ 1 A*'F)*q + Pb 

(2.35) 

+ — - — (A* + PAS*)(££*) -1 (a - rl) = 0. 
1-7 

We have the following results. 

PROPOSITION 2.3 [25]. In addition to (Al), we assume (A2). Then the 
following properties hold: 

(i) P(t) = P(t; T) converges as T — > oo to a nonpositive definite matrix 
P, which is a solution of the algebraic Riccati equation (2.34). Moreover, 

Ki + AN~ X A*P 

is stable, and P satisfies the estimate 

POO 

(2.36) - / e sG *A*(ZE*)- 1 Ae sG ds<P<0, 

Jo 

where G is given in (A2). 
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(ii) q(t) = q(t; T) converges as T — )■ oo to a constant vector q which satis- 
fies (2.35). Moreover, —h(t) = —h(t;T) converges to a constant x(t) defined 
by 

X ( 7 ) = \ tr(AA*P) + \q* AA*q + b*q + 7 r 

(2.37) 7 

2(1-7) 

(iii) We obtain 

(2. 38 ) Um *rt =lim M5Z) =x(7) . 

T— >0O i T— 5-00 i 

The proof of Proposition 2.3 can be found in [25]. Some remarks will be 
also given in Section 4.2. 

We use £ 7 (y), -P( 7 ), 9(7) for the dependence of £(y),P,q on 7. 

Proposition 2.4. ^4/ong mi/i (04^ and (04,2), we assume (A3); 

(A3) (-S)A) *s controllable. 

Then the pair (£,x(t)) ^ fte unique solution of (2.23) with X = x{l) 
where and x(t) are ?roen fry (2.33) and (2.37), respectively. 

The proof of Proposition 2.4 will be given in Section 4.2. 

Remark 2.3. The pair (K,L), of the n x n matrix K and the n x / 
matrix L, is said controllable if the nxnl matrix (L, KL, K 2 L, . . . ,K n ~ l L) 
has rank n. We remark that the generator of It, Qf = \ tr(AA*D 2 f)+f3-Df, 
is an hypoelliptic second-order operator if (A3) holds (see [20]). 

Remark 2.4. It is shown in [22] that there is x*(l) such that for any 
X — X*{l)i (2.23) has a solution There are only finitely many particular 
x's where the solution £(y) is quadratic in y. Under certain conditions, 
(2.23), for X = X*(l)i nas a unique solution satisfying £*(0) =0. The 

unique pair x*(7)>£*(") may also be characterized by the growth condition 

°f £*(y) as \y\ ~~ 00 ( see [27]). 

The differentiability of £ 7 (y) [or x(t)> P(7)iQ(l)] wm pl a Y an important 
role in the proof of our main theorem (Theorem 2.1). We have the following 
results. 



Proposition 2.5. Under assumptions (Al) and (A2), the following re- 
sults hold: 
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(i) x(l) an d P(rf)i 9(7) are twice differentiable with respect to 7. 

(ii) x{l) i s convex with respect to 7. 

The proof of Proposition 2.5(i) [and (ii)] will be given in Section 4.3 (and 
Section 4.4). 

Similar to (2.32), we use £(■) to define 

n 7 (y) = -^(££T V(y) ~rl + WD£(y)) 
1 — 7 

(2.39) 

= ^-(SS*)" 1 ^ - rl + EA*g( 7 ) + {A + SA*P( 7 )}y]. 
1-7 

Now we also define 

/3 7 (y) := P(y) + 7AS*7T 7 (y) + AA*£>£(y) 



(2.40) 



where 



Define 



b + By + -^—AE*CET,*)- 1 (a + Ay - rl) 
1-7 

+ AiY- 1 A*(P( 7 )y + g(7)) 



(^ 1 + A^ i A*P(7)) 2/ + /. 



1 ■ 



f •= b + — i— AS*(SE*) _1 (a - rl) + AN A*q. 
1-7 



u = «(i/) :={A* J D^y) + 7 E*7r 7 (y)r 
(2.41) =U*(Py + q) 



+ — i— E^EE'J-^EA^Py + g) + a + Ay -rl) 
1-7 

We will show 

(2.42) E\S\J udW S j^=l, t>0. 

Then we define a new probability measure P by 



:=£[ I udW 



Define Wt by 

(2.44) W t = W t - I u{Y s )*ds. 

Jo 
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Then Wt is a Brownian motion under the probability measure P, and Y 
satisfies 

(2.45) dY t =P 7 (Y t )dt + AdW t . 



Remark 2.5. We compare /3 7 (y) in (2.40) and /?(-,•) in (2.19), 

/3 7 (y)=/3(y,7r 7 (y)) + AA*(P( 7 )y + g(7)). 

As shown in (2.16), /3(y,7r 7 (y)) is used to change the measure to derive the 
useful expression of J(x, y, n; T). Because of the integral from to T in (2.16) 
when ixt = 7r 7 (Yf), the expectation may grow exponentially and will cause 
difficulty in the analysis. The difference of /? 7 (y) and /3(y, 7r 7 (y)) is made to 
take care of this. This gives another measure change, hence another term is 
added to /3(y,7r 7 (y)) which leads to /3 7 (y). A similar idea is used in [23]. In 
the proof of our main theorem (Theorem 2.1), we will also see some uses of 
P. 

Under P, Yt is a Gaussian process. The variance of Yt is given by U(t), 
1 e (t- s )(JsTi+AAr-iA*P) AA * e (i-s)(i<ri+AAr- 1 A*p)* ds 

and its mean m(t) is the solution of the following equation: 

m(t) = (#1 + AiV _1 A*P)m(t) + f T 

We show in the next proposition that K\ + A* N^ 1 A* P is stable under as- 
sumption (A2); then Yj is ergodic under P. 

Proposition 2.6. Under assumptions (Al) and (A 2), K 1 +A*N~ 1 A*P 
is stable. There are 01(7) > 0,02(7) > and a positive definite n x n matrix 
K 7 such that 

(2.46) y*A 7 /? 7 (y) < - Cl ( 7 )M 2 + c 2 ( 7 ), 
where /3 7 (y) is given by (2.40). 

The proof is given in Section 4.5. 

Proposition 2.7. Under assumptions (Al) and (A2) we obtain 

(2.47) lim x'( 7 )=r. 
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For the proof, see Section 4.6. This result gives the range of k in (2.8) 
that our main result holds (Theorem 2.1). 

We can now state our main theorem. Its proof, given in next section, is 
based on the results in Propositions 2.1-2.7. 

Theorem 2.1. Assume (Al) and (A2). Then, for all r < k < x'(O-), 
we have the following: 

(2.48) II(fc) = inf {x( 7 ) - 7^}- 

7<0 

Moreover, define the strategy, 

(2.49) n [ t ] :=7r(t,Y t 



th 



where Tf(t,y) is defined in (2.32) with 7 = "f(k). Here j(k) < s.t. x'(t(&)) = 
k € (r, x'(0— )). We denote x'(l) = Then 7r[ fc ], on the sufficiently large 

time horizon T, is a nearly optimal strategy for the problem (2.7), namely, 



For k <r, 



U(k) = lim -logP T <k). 



U(k) = inf {x(7) - 7^} = -°o. 

7<0 



If B is stable, then 

(2.50) x(0- 

and 

x' ( 0-) = itr(AA^(0-)) 

(2.51) 



+ UAB^b -{a- rl))*(SS*)- 1 (AP- 1 6 - (a - rl)) + r, 
where 

rfp r°° 

^L(0-)=/ e^A^W^Ae^ds, 
«7 Jo 

n(fc) = inf{x(7)-7fe} = 0, k> X '(0-). 

7<0 

Remark 2.6. In Proposition 2.2, for a given T, 

P(t)=P(t;T), q(t)=q(t;T), h(t) = h(t;T) 

and 

Tv(t,y) = n(t,y;T). 
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Hence, to avoid confusion, we may use 7?t" ,fc for ir t . Therefore, for 7 = j(k), 
E((xf' k y)= inf E((XW). 

7f^' fc is an optimal strategy for (2.9) [7 = j(k)] but may not be an optimal 
strategy for (2.7). This is the reason we say Trf' k is nearly optimal for (2.7) 
when T is large, since the value using this strategy is close to the optimal 
value when T is large. 

On the other hand, we can use 7r 7 (-) in (2.39) to define 

7r 7 (i) = n 7 (Y t ). 

We may expect that this will also give a nearly optimal strategy. That is, in 
a sense, 

(2.52) E((Xpy) 
is close to 

inf E((X%r), 

if T is large. There are two problems when one wants to prove this rigorously. 
For the first problem, it is not easy to show vr 7 (-) is an element of At- For the 
second problem, it may happen that (2.52) becomes infinite for some finite 
T. See [14] for a study of a model where there is one stock in the market. 
When this happens, the problem (2.24) may not have a solution. That is, 
there is no optimal strategy for (2.24). However, it is shown in [14] that 
some modification of vr 7 (-) gives a nearly optimal strategy. Such behavior 
also indicates that (2.25) may be more difficult to treat than (2.8). However, 
if we assume (Al)-(A3) and the following condition, 

P(7)AS*(SS*)~ 1 SA*P( 7 ) < A* (EE*)- 1 A, 

then it is proved in [25] (Theorem 2.3) that 

lim hogE{Xp)= X {l). 
1 —^00 1 

Using this and following the same argument as in Theorem 2.1, we can obtain 
the upper estimate for down-side risk probability. For the lower estimate, 
the same argument in Theorem 2.1 can be applied. In conclusion, we have 
the following result; its proof is omitted. 

Theorem 2.2. Assume (Al)-(AS). Let r <k< x'(O-) and j(k) < be 
the unique number satisfying x'(l(k)) = k. Assume 

P( 7 (A;))AS*(SS*)~ 1 SA*P(7(A:)) < ^(SS*)^ 1 ^. 
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Define 

7Tfc(t) :=7T 7(fc) (y i ). 

Then 7Tfc(-) G A/r /or any T and 7?fc on a sufficiently large time horizon T is 
a nearly optimal strategy for the problem (2.7). Namely, 

U(k) = lim Llogp( l ^t<k). 

In (2.25) we define A to be a family consisting of processes Tit such that 
^\[o,T}; the restriction of TT t to [0, T], is in At for all T. Then 7?fc(-) G A and 
is an optimal strategy for (2.25). 

3. Proof of Theorem 2.1. In this section, we shall give a proof of our main 
theorem using results in Propositions 2.1-2.7. The proof of the propositions 
will be given in Section 4. 

From Proposition 2.5(h), x is convex. Let us consider 

X(k) ■= inf{x(7) k>r. 

7<0 

Since x is smooth, we see that x(k) is strictly concave, nondecreasing and 
satisfies 

*™_/o, if fc> x '(o-), 

X[ ' ~ \ X(l(k)) - l(k) X '(l(k)), if r<k< X '(0-), 

where 7(d) < is such that x'{l{d)) = d G (r, x'(0— )). In Section 4.4, we will 
show x'(l) > f° r 7 < 0. Therefore, 7(d) is uniquely defined. Moreover, x 
is continuous on (r, x'(0 — ))• 

We now take a small e > 0. Then k — e > r. Suppose 7 < attains the 
following: 

X(k - e) := inf \{x{l) ~ l(k - e)} = x{l) ~ l(k - e). 

7<0 

Note that 

(3.1) k-e = x\l). 

We denote 7 as 7 in the following. 

From Proposition 2.3, we recall that the pair (x(7)j£) solves (2.23); 

X ( 7 ) = i tr(AA*D 2 £) + U> + By + j^AS* (EE*)" 1 (o + Ay - rl)| D£ 
+ i(Df)* A -W _1 A*Df 

+ on 7 r (o + Ay - rl)*(SS*)- 1 (a + Ay - rl) + 7 r, 
2(1-7) 
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or, equivalently, 

(3.2) X ( 7 ) = | tr(AA*£> 2 £(y)) + Py(y)*D£(y) + V , 
where /3 7 (y) is defined in (2.40) and 

V = V (y) 

(3.3) :=-^C(y)*AiV- 1 AL>e(y) 

-(a + Ay - rl)*(SS*)~ 1 (a + Ay - rl) + 7 r. 



2(l- 7 ) 

By differentiation of (3.2) with respect to 7, we have 
X '( 7 ) = ^ tr(AA* ZA^y)) + ^{yfDr ] {y) 

+ 7q 1 ^ AS^ES*)- 1 ^ + ^ " rl)*D£ 
(I-7) 2 

+ on 1 ^ 2 P0*(y)AS*(ss*)- 1 SA*J>e(y) 
2(1-7) 

+ 2(1- 7)2 (a + Ay ~ ^n^T 1 ^ + ^ - rl) + r, 
where rj = That is, 

(3.4) X '( 7 ) = 1 tr(AA* D 2 V (y)) + ^(y)*Dr,(y) + V u 

Vi = V 1 {y) := * {SA*£>g(y) + {a + Ay- rl)}*^)- 1 

(3.5) 

x {£A*D£(y) + (a + Ay- rl)} + r. 
Furthermore, from (3.2) and (3.4), we can obtain 

xii) - ix'ii) 

(3.6) 

= \ tr(AA*D 2 (£ - 77?)(y)) + P 7 (y)*D({; - 7 r?)(y) + V 2 , 
where V 2 is defined by 

(3-7) V 2 = V 2 (y) = -±\u\ 2 - 

u(-) is in (2.41). Indeed, from (3.2) and (3.4), 

X(7) " ix'il) = \ tr(AA*D 2 (Z - 77?) (y)) + /3 7 (y)*L>(£ - 7*7) fo) + F - 7^1- 
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By (3.3) and (3.5), a straightforward calculation shows that 
VQ-yV 1 = ~DC{y)*AA*D^y) 



1 



{EA*D£(y) + (a + Ay - rl)}*(SE*)- 1 EA*^(y) 



1-7 



1 



1 



, {VA*Dt(y) + (a + Ay-rl)Y 
2 \1 — 7 J 

x (EE*)" 1 ^*!)^?/) + {a + Ay - rl)} 



1 



u 



where the last equality follows from (2.41). Hence we have (3.7). 
For 7r G At, we have by (2.6), 



X?[. = x exp 
Then 



J {r + (a + AY t -rl)*ir t -^XX*Trt\dt + n^dWt 



joggf log* 1 /- T 



1 

+ T 



^<EE*7r t + K(a + AY t - rl) + r} 



Recalling Wt defined by (2.44), we can rewrite the last relation as 
log*? logx 1 f T ~ 



X XT,* I 7T t 



1 



(EET^EA^y) + a + AY t - rl) 



1-7 



1-7 



(EE*) (EA*-D£(y) + a + AY t - rl) ^ dt 



+ 



1 



T 



1 



:(SA*De(y t ) + o + Ay t -rl) 



TJo l2(l- 7 ) 2 

x (EE*) _1 (EA*D^(y t ) + a + AY t - rl) + ? 

From (3.5) and with some calculation, we can rewrite this as 



log log x 1 



1 



1-7 



{(EE*) -i (EA*Z)^(y t ) 
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+ a + AY t -rl)}*ZdW t 
(3.8) +^log£(J L- ^(ESTW^Cn 



+ a + Ay-rl) J> Sdt? ) 



1 f T 

+ -y o Fi(y t )di. 



Define the following events: 



1 







^2,T := jw; ^ ^ «(y t )* dWt < ej 



and 

logx 1 



+ a + ^F t -rl)}*SdT?t< j|, 

x(EA*D£(Y) + a + AY -rl^J EdW^J < J J. 
From (3.1) and (3.8), we see that 

(3.9) A 3 , T n A 4iT n A 5yT c A. 

Recall that P is the probability defined by (2.43). By using (3.6), (2.45) 
and Ito's formula, we have 

(£ " 1V)(Xt) - (e - 7^?)(y) = (X(7) - 7x'(7))r - C V 2 (Y t ) dt 



Jo 

T 

D^- ir] y{Y t )KdW t . 



o 
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We apply Chebyshev's inequality: 



1 



P(Al T ) < -=E 



X(7) - 7X'(7) 



V 2 (Y t )dt 



2n 



< 



£ 2 T 2 



E 



(Z—yri)(YT)-(Z->yv)(y) 



T 



D^- 1V y(Y t )AdW t 

Noting that £(y), and r](y) are quadratic in y, then 

\(C-ir])(y)\<K(l + \y\ 2 ), 
\D(Z- JV )(y)\<K(l + \y\). 

Therefore, we have 



E {Z—yv)(YT)-(S—YV)(v)- I D{i- T1 Y{Y t )\{Y t )dW t 

T 



<d 1 ( 7 ){|?/| 4 + i + (|?/| 2 + i)r} 

for some di(j) > where the last inequality follows from Lemma 3.1 below. 
Therefore, we see that 



o 



< K{1 + |y| 4 + T + E[\Y T \ A ] + / E[\Y t \ 2 } dt 



P(AW) < 



and 
(3.10) 



£ 2 T 2 



P(Al T )<e, 



provided T is sufficiently large. 

By using Chebyshev's inequality again, we have 

2n 



u{Y t )*dW t 



1 



£ 2 T 2 



E 



T 



\u(Y t )\ 2 dt 



By (2.41) and using \D£(y)\ < K(l + \y\), we obtain 



K 



T 



P(Al T )<^[T + ^ E[\Y t \']dt 
d2{i){\y? + i) 



< 



T 2 T 



24 



H. HATA, H. NAGAI AND S.-J. SHEU 



for some ^2(7) > where the last inequality follows from Lemma 3.1 below. 
Therefore, we see that 



(3.11) 



P{A% T )<e, 



provided T is sufficiently large. 

Using a similar argument, we can show 

(3.12) P(Ai >T )<e. 

We now consider P{A^ T ). By (3.4) and Ito's formula, 

d V (Y t ) = -V x {Y t ) dt + X '(7) dt + (D V (Y t ))*AdW t . 
From this, we have 



V 1 (Y t )dt = r ] (Y )- V (Y T ) + X '(l)T+ \ (D V (Y t ))* AdW t . 
Then, ^3 t is the same as 



\ogx T](Y Q ) — rj(Yp) , 1 



+ 



+ 



5 rj-i ' rp ' rj-i 

Now we can use the same argument as above to get 
(3.13) P(A c 3 ,t)<b, 

provided T is sufficiently large. 
For A^T, we have 

P{At T ) < e~^T 



(Drj(Y t ))*AdW t < 



x E 



7T 



(EE*) _1 (£A*Df(y) 



1-7 



+ a + AY -rl)\ Y,dW 



< e- £ / 4T . 
Then we have 
(3.14) 



P(Al T )<e, 



if T is sufficiently large. 

Hence, from (3.7), (3.9), (3.10), (3.11), (3.12), (3.13) and (3.14), we have 



P(A)=E 



exp 



u{Y t )*dW t - \ I 



E 
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expj-^ u(Y t )*dW t + J V 2 (Y t )dt\;A 



> exp[( X (7) - 7X'(7) - 2e)T] • P(^i, T fl A 2>r n A) 

> exp[(x(7) - 7X'(7) " 2e)T] • P(Ai, T n A 2 , T n A^ T n A 4 , T n A 5 , 

> exp[( X (7) - 7X'(7) - 2e)T\ • (1 - 5e). 

The estimate of P(A) is uniform in ir. Therefore, we see that 

II(fc) > lim 1 log{exp[( X (7) - 7X '( 7 ) - 2e)T] • (1 - 5e)} 

T->oo J 

= x(fc - e) - 2e. 

By continuity of x on (x'( — °°)> x'(0 — )) an d sending £ to 0, we obtain 
(3.15) n(fc)>inf{ X (7)-7fc}- 

7<0 



On the other hand, if ir = tt^, we have 

p 0^- <kj= p((xzyw > e 7(fc)fcT) 

= exp(7(/c) logx 4- v(0, y;T; j(k)) - j(k)kT). 



Therefore, by Proposition 2.3(iii) 



1 /loe-X 71 " \ 

lim -logP fe T <k) < X {l{k))-l{k)k 



T-too 

= x 

Together with (3.15), we get 



7<0 



U(k) = lim -logP V < fc = ini :{ X ( 7 ) -jk}. 

We have proved (2.48). 

We now consider k <r. By convexity of x(")j we have 

x(-l)>x(7)+X / (7)(-l-7), 7<-l- 

That is, 

X(7) " < x(-l) + x'(7) + 7(x'(7) " k). 
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Since x'il) is bounded, x'(l) ~ > r as 7 ~~ * ~°° (Proposition 2.7), we see 
x(l) — 7& — > —00, 7 — > —00. 

In particular, 

inf {x(l) -7^} = -00. 

7<0 

On the other hand, we take ir = 0. Then 

X$ = xexp(rT), 

(log \ 
— T < j = if T is sufficiently large. 

In particular, H(k) = —00. 

We now assume that B is stable. Consider ^e tK i Pe tKl and use (2.34). 
We can show 

P-e tK *Pe tKl = [ e sK ^{PKN~ l k*P -C*C)e sKl ds. 
Jo 

Since K\ is stable if 7 < is near [see (2.28)], when t tends to infinite, we 
have 



poo poo 

-P+ e sK *PKN- 1 h*Pe sKl ds= / e sK *C*Ce sKl ds. 
Jo Jo 



We want to let 7 — > 0— for P = -P( 7 ). By Proposition 2.3(i), — -P( 7 ) is non- 
negative. The above relation implies that —P{^f) is bounded above as 7 — >• 0. 
By (4.9) in the next section, P( 7 ) is nondecreasing. Therefore, 

P(O-) = lim P( 7 ) 
7— co- 
exists and is nonpositive definite. Since C( 7 ) — > as 7 — > 0— , we take the 
limit in the above relation and we easily see P(0— ) = 0. 
By (2.35), 

5*5(0-) = 0. 

We have q(0-) = 0. From (2.37), we have x(0-) = 0. We have proved (2.50). 
Using (4.9), we obtain 



a 7 



poo 

/ e sB * A*{Y,Y?)- 1 Ae sB ds. 
Jo 



By (4.12), we have 

~dP 



^-(0-)6 + A*(ES*) _1 (o - rl) 
07 
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By (4.13), we have 

X'(O-) = \ tr (V fV)) + ^(0-)*6 + rl^EE*)- 1 ^ - rl) + 
Using the above expression for ^(0— ), we can show 

B* V(O-) + V(0-)S = -^(EE*)- 1 ^. 
07 «7 

Multiplying this by (I?*) -1 on the left and B~ l on the right, we have 

(#*)-! — (0-) + ^-(O-)S" 1 = -(B*)~ 1 A*(T,lTy 1 AB~ 1 . 

dry dry 

Then 

r/P 

(^)-i_(0-)6.6 

= --(AB^^EE*)- 1 ^- 1 ^ 

^(O-rft + ^a-rirCEET^a-rl) 

= ^{AB^b - (a - rl))*(EE*)- 1 (Afi- 1 6 - (a - rl)). 

An expression of x'(0— ) as in (2.51) follows. 
Finally, we show 

inf{ X (7)-7fe} = 0, k> x '(0-). 

7<0 



Let k > x'(0—). Since x(0— ) = 0, we have 
Take fa <x'(0-)- Then 

n(*i) = 

n(fci)=x(7(*i))-7(fci)fci, 



inf {x( 7 ) - 7^} < 0. 

7<0 



n(fci) = inf {x(7) - lh} < inf {x(7) - 7^}, 

7<0 7<0 



where 

x'( 7 (fci)) = fci. 

7(jfei) -4 0- as fa -> x'(O-). Then n(jfei) -> as fa -4 x'(O-). Therefore, 

inf {x( 7 ) - 7*} > 0; 

7<0 
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hence 

7<0 

This completes the proof of our main theorem. The following is a lemma 
used in the above proof. 

Lemma 3.1. Assume (Al) and (A2). Then, for allp> 1, there is M = 
M( 7 ,p) such that 

(3.16) E[\Y t \ 2p ]<\y\ 2p + M, t>0. 

Proof. Let K~ be the positive definite matrix in Proposition 2.6. We 
apply Ito's differential rule to (Y t *K^Yt) p . Y% is given in (2.45) and we 
consider the probability P [in (2.43)]. To simplify the calculation, we as- 
sume K~f = I (identity matrix) in the following. Noting that (2.46) holds for 
Kry = I, we have 

d\Y t \ 2p = 2p\Y t \ 2 ^Y;Adw t + 2p\Y t \ 2 ^Y t *^{Y t )dt 

+ p|y t | 2(p_1) tr AA* ds + 2p(p - l)|Y t | 2 ( p ~ 2 )>7AA*y 4 dt 
<2p\Y t \ 2( - p -^Y t *AdW t 

+ p\Y t \ 2 ^{-2c l { 1 )\Y t \ 2 + 2c 2 ( 7 ) + c 3 }dt 
for some C3 > 0. Moreover, if we take 9 as < 6 < 2pci( 7 ), then we have 
d\Y t \ 2p e 9t < 2pe 9t \Y t \ 2{ P~ 1 '>Y t *AdWt 

+ e et \Y t \ 2 (P-%{-2 Cl ( 7 )\Y t \ 2 + 2c 2 ( 7 ) + c 3 } + 9\Y t \ 2 } dt 
< 2pe et \Y t \ 2{ P-^Y* KdW t + e et Mdt, 

where 

M := sup |y| 2(? '~ 1) [p{-2c 1 (7)|y| 2 + 2c 2 ( 7 ) + c 3 } + %| 2 ]. 
y 

Therefore, we obtain 

\ Yt \ 2p < \ y \ 2p + - e - et ) + 2p f e- 6 ^\Y s \ 2 ^Y s *AdW s . 

V Jo 
From this, by an argument using a stopping time, we obtain (3.16) with 
M = M/9. □ 

Remark 3.1. The proof of Theorem 2 . 1 is based on the results in Propo- 
sitions 2.1-2.7. It is interesting to verify these results for more general non- 
Gaussian models. We make the following observation. If we assume: 
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(i) a, a, f3, A are globally Lipschitz; 

(ii) Milei 2 < eW(l/)£ < ^ 2 |€| 2 ,^i,M2 > 0; 

(iii) z^x | ^ | 2 < £*AA*(y)£ < v 2 \£\ 2 ,v 1 ,v 2 > 0; then there is x*(t) such that 
(2.23) has a solution for % > x*(l) ( see Theorem 2.6 in [22]). Moreover, under 
certain conditions, there is a unique solution £ 7 (y) with £ 7 (0) = for x = 
X*(l) ( see Theorem 3.8 in [22]). Assume AA* is positive, and for Gaussian 
cases studied here that satisfy the conditions (Al), (A2), (A3), x*(l) = 
x(l)i£X(y) = £y(y)i which are defined in Proposition 2.3. It is an interesting 
problem to find conditions on coefficients that prove other propositions. 

4. Proof of propositions. 

4.1. Finite time horizon problem. In this subsection, we prove Propo- 
sitions 2.1 and 2.2. We follow closely the arguments of Kuroda and Nagai 
[25]. 

First of all, we attack the finite time horizon problem (2.9). Then the 
solution v of the Bellman equation (2.21) can be expressed as quadratic 
function such that 

v{t,y) = \y*P{t)y + q{t)*y + h{t), 

provided that equation (2.27) has a solution. Here q and h are solutions of 
(2.29) and (2.30), respectively. We recall the following result (5.2) in [13], 
Theorem IV. If 7 < 0, then we see that (2.27) has the unique solution P(t) < 
0. See also Remark 1 of Section 2 in [25], but notice that 7 and the solution 
P(t) of (2.27) correspond to — | and — |P(i) in [25], respectively. Therefore, 
as in the proof of Theorem 2.1 in [25], we obtain Propositions 2.1 and 2.2. 

4.2. Asymptotics as T — > 00. In this section we prove Propositions 2.3 
and 2.4. Here we recall the following theorem (see Theorem 4.1 and Lemma 
5.2 in [38]). 

Theorem 4.1 [38]. Assume that N > and (K±,A) is stabilizable, then 
for the solution Q(t) = Q(t;T) of 

(au j Q(t) + KlQ{t) + Q(t)Kx - Q(t)AN~ 1 A*Q(t) + C*C = 0, 
{ -> \Q(T) = 0. 

31imT-><x> Q(t',T) = Q, and Q satisfies the algebraic Riccati equation, 

(4.2) KlQ + QKx -QAN~ 1 A*Q + C*C = 0. 

Moreover, if {C,K\) is detectable, then K* — AN~ l A*Q is stable and the 
nonnegative definite solution of (4-2) is unique. 
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Remark 4.1. The pair (L,M) of the n x n matrix L and the n x ^ 
matrix M is stabilizable if there exists a I x n matrix K such that L — MK 
is stable. The pair (L, F) of the / x n matrix L and the n x n matrix F is 
called detectable if (F*,L*) is stabilizable. 

Proof of Proposition 2.3(i) and (ii). Let us set Q{t) = -P{t). 
Then we see that Q satisfies (4.1). Let K±,C be given in (2.28). Take 
K = X^EE*)- 1 ^. Then K\ — AK = B — AS*(EE*) _1 A = G is stable. Note 



also that if we set Ki := y 7 (i_ 7 ) A*, then iff — Ci^ = G* is stable [G 

is given in (A2)]. Therefore, we see that (K\,A) is stabilizable, (C,K\) is 
detectable and Theorem 4.1 applies. Then we can follow the arguments of 
Proposition 2.2 in Kuroda and Nagai [25]; we omit the details here. 

PROOF of Proposition 2 . 3 (iii) . Note that P(t; T) is uniformly bounded 
with respect to t and T (see Remark 1 of Section 4 in [25]). Moreover, 
since K\ + AN~ 1 A*P(t;T) converges to a stable matrix K x + AiV _1 A*P 
as T-> 00, we can show by (2.29) that q(t;T) is uniformly bounded with 
respect to t and T. See Lemma 4.4 in [25]. Therefore we obtain (2.38). □ 

Proof of Proposition 2.4. Let us assume (A1)~(A3). Then we have 
the solution P of (2.34) and q of (2.35). Moreover, the pair (S,(y),x(l)) of 
£(y), defined by (2.33) and xil) defined by (2.37), satisfies (2.23) (cf. Section 
2 in Kuroda and Nagai [25]). Here we note that from (A2), K\ +AN~ 1 A*P 
is stable (by Theorem 4.1). Moreover, from (A3) we see that the variance of 
Yt under P [defined in (2.43)] is nondegenerate (see Lemma 5.1 of Kuroda 
and Nagai [25]). Therefore, we see that Yt given by (2.45) is P-ergodic. The 
rest of the proof follows closely the arguments of Theorem 3.8 in Kaise and 
Sheu [22] and is omitted here. □ 

4.3. Differentiability with respect to HARA parameter 7. In this subsec- 
tion, we shall prove Proposition 2.5(i). Let us first note that the Riccati 
differential equation (2.1) can be solved by considering a Hamiltonian sys- 
tem. Indeed, introduce a Hamiltonian matrix Tl defined by 

-Kx AN~ X A* 
C*C K\ 

and consider the ordinary differential equation 

See Chapter V in [1]. Note that U and V are n x n matrix valued functions 
on < t < T, and E n is the nxn unit matrix. Then it is known that U(t) is 



(4.3) U 
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invertible, and W(t) := F(t)C/(f)~ 1 is the solution to the Riccati differential 
equation 

(A K\ ! ^(*) = K * W ( t ) + W(t)Kx - W(t)AN~ 1 A*W(i) + C*C, 
{ ' \W(0)=0. 

Then we see that, by setting P(t) := -P(T -t;T), we have P(t) = W(t). 

Lemma 4.1. The solution P(t) := P(t; T; 7) to the Riccati equation (2.27) 
is in C 1 -class with respect to 7. 

Proof. The Hamiltonian matrix % defined by (4.3) is smooth with 
respect to 7 and so is the solution (U(t),V(t))* of (4.4). Moreover, U(t) is 
invertible. Therefore, f/(i) _1 is in C 1 -class and 

Thus we see that W(t) = l/(i)t/(i) -1 is in C 1 -class with respect to 7. Hence 
we conclude our present lemma. □ 

Now, let us rewrite (2.27) as 

Pit) + (K x + AN~ 1 A*P(t))*P(t) + P(t)(Ki + AN- 1 A*P(t)) 

(4.6) 

- P(t)AN- 1 A*P(t) - C*C = 0. 
Then by differentiating (4.6) with respect to 7, we obtain 

BP 

(4.7) +— (K 1 +AN- 1 A*P(t)) 

07 

+ tz 1 ,J ZA*P(t) + A)*(SS*)~ 1 (SA*P(t) + A) = 0. 

Then we obtain the following lemma. 

Lemma 4.2. Assume (Al) and (A2). Then the solution ^(t;T;^) of 
(4-V converges to 4£ which satisfies 



(IP dP 

(K x + AN~ 1 A*P)*-— + ^—(K x + AN~ 1 A*P) 
(27 07 

(4-8) 

+ -^(sa*p + a)*(ee*) _1 (ea*p + a) = 0. 

(1 -t) 2 
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Moreover, we obtain the following expression: 

(4.9) ^ (1 " 7) J ° 

x (ZZ*y\ZA*P + A)e s ( Kl+AN ~ lA * p Us. 



PROOF. Note that K\ + AN~ 1 A*P(t; T) converges to the stable matrix 
Ki + AN' 1 A* P. We can see that similar to Lemma 4.4 of [25], ^-(t;T) 

converges to a matrix (^p) which satisfies 

dp 



(Ki + AN~ 1 A*P)* 



1 

Then 



+ (^P)(K 1 +AN- 1 A*P) 



■(EA*P + A)*(EE*) _1 (EA*P + A) = 



Mk 1+ an-ia*p)* ( {Ri + AN -i A * T y ( dP\ 



(l- 7 )2 

x (^P + A^^ 1 ^ 
Integrating over t, then (^-) satisfies 



V ^7 7 

+ {Kl + AAT^P)) e^+AA^A-P) 

e*(^+ A7V " lA * p )*(SA*P + A)*(SS*)- 1 



_ t(iti+AAT- 1 A*P)* / £^ \ t(ifi+AAT- 1 A*P) 



(?7 J ydj 

= f ' e s(K 1+ AN-lA*Py (SA *p + A y 

(1-7) 

x (ES^-^EA*? + A)e^ 1+AAr ~ lA *^ ds. 

We see that 

3 ° e ^ 1+ A^V-^P)* (SA *p + ^ r 



dl) {I -if 
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(4-10) _ 

x (ES*)- 1 (EA*P + A)e , ^ 1+AAr " A * p ) da. 

On the other hand, we have 

P( 7 + A) - P( 7 ) = lim {P(t; T; 7 + A) - P(t; T; 7)} 

T— >oo 



lim / ——(t;T;u)du 
(u) du. 



From (4.10), (^-) is continuous with respect to 7. Therefore, we see that P 
is differentiable with respect to 7, and 717(7) = (§?)( 7 )- D 



As for differentiability of q with respect to 7, we can see this is similar 
to Lemma 4.2. Indeed, (2.29) is a linear equation and its coefficients are 
all in C 1 -class with respect to 7. Therefore, the solution q(t) of (2.29) is in 
C 1 -class with respect to 7, and we have 

|(|) + (Kl+AW - w | + ^±^™ 9(t) 

f)P 1 

(4.11) + — b + -2 (EA*P(t) + ^^EET^ - rl) 

07 (l~7r 

'V OP 

+ — ^— t- AS*(SE*)- X (a - rl) = 0. 
I-7 07 

Thus we have the following lemma, similar to Lemma 4.2. 

Lemma 4.3. Under assumptions (Al) and (A2), asT^oo, ^(t;T;^), 
the solution of (4-H) converges to ^ which satisfies 

(4.12) ^ Kl + AN- 1 A*T)*^ + ^('r,^ 3 P,i\ =0, 
where 

$ f7,^,P^ := L 1 ,- AS*(SS i,, )- 1 (.A + SA*?)+AJV- 1 A*^ 
V ^7 y L( 1 -7) 2 ^7 

— — 

d7 + 3 7) 2 



— — 6 + r^(A + EA*P)*(EE*)" 1 (a - rl) 



+ AE*(EE*) _1 (a - rl). 

1 — 7 C17 
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Differentiability of x{l) is directly seen from (2.37). Indeed, we have 

^4tr(AA*fWAA*^ + &*^+r 
d'y 2 \ cry / d'j d'j 

(4.13) + — 1 .- (a - rl + EA*g)*(ES*)- 1 (a - rl + EA*g) 

2(1 -ir 

+ — L_ (a - rl + EA*?)*(EE*)- 1 SA* 
1 — 7 cry 

The following lemma is a direct consequence of (4.9), (4.12) and (4.13). 

Lemma 4.4. Under assumptions (Al) and (A 2), and ^ are dif- 

ferentiable with respect to 7. 

PROOF. Differentiability of is seen by looking at (4.9). As for 
from (4.12) we obtain 



and so it turns out to be differ entiable. From these facts and (4.13), differ- 



entiability of follows. □ 



4.4. Convexity of x- I n this subsection, we shall show Proposition 2.5(h). 

Proof of Proposition 2.5(h). Note that Ki + AN~ 1 A*P is stable 
under assumption (A2). In the previous subsection, namely the proof of 
Proposition 2.5(i), we have shown in Lemma 4.4 that under assumptions 
(Al) and (A2), P,q and x are twice differentiable with respect to 7 and so 
is £. Recall that 

^(7) = l -tT{AA*D 2 n {y)) + ^{yYD n {y) + V u 
where r) := /3 7 (y) is given by (2.40) and V\ is defined by (3.5). Moreover, 



ih, 
i'h 



a2c 

setting Q := , we have 



/2 (7) = - tr(AA* DX(y)) + fir(y) m DC(y) + ) D V (y) 

+ n\f ( EA * D ^ + ( a + A v- rl )V 



x (EE*)- 1 {SA*D^(y) + (a + Ay - rl)} 
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x {£A*L>£(y) + (a + Ay-ri)}. 

Using 

fffo) = 7i332 AS *( SS *) _1 {SA*I>e(l/) + (a + Ay - rl)} 
+ AA^ X A* Dr/(y), 



we obtain 

2 * r ( 7 ) = 1 tr(AA*D 2 C(y)) + /3 7 (y)*DC + ^(y; 7), 



di 1 
where 

^; 7 ):=( J Dr / )*(y)A(/-S*(SS*)- 1 S)A^r / (y) 

+ (TT33 {C 1 " 7)SA*^(y) + £A*D£(y) + (a + Ay - rl)}* 

x (SE*)- 1 {(1 - 7 )SA* J D? ? (y) + £A*D£(y) + (a + Ay - rl)}. 
Note that \£{y;j)\ < K(l + |y| 2 ). From (3.16) we can see that 



—^(7) = lim — E 



T 



£(Y s ; 7 )ds 



< 00. 



Since l(y;~f) > 0, we conclude ^(7) > 0. Therefore, Proposition 2.5(h) is 
obtained. □ 

4.5. Proof of Proposition 2.6. Recall that K\ + AN~ 1 A*P is stable from 
Theorem 4.1. Let us set G := K\ + AiV _1 A*P, and consider 

K := / e tG e tG dt>0. 



Then K satisfies the following equation: 

G*K + KG = -I. 

Therefore, we have 

(KGy,y) + (y,KGy) = -(y,y), 
(Gy,Ky) = -±(y,y). 

Since 

/3 7 (y) = Gy + / 7 

[see (2.40)], we can deduce (2.46) after some calculation. Here = K, 01(7) 
1/4, and c 2 ( 7 ) = |K/ 7 | 2 . 
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4.6. Asymptotics as 7 —¥ —00 . In this subsection we shall consider asymp- 

<h 



totic behavior of 3^(7) as 7 — >■ —00, and obtain Proposition 2.7. 



Proof of Proposition 2.7. We first consider P(j) which is a solution 

of the algebraic Riccati equation (2.34). We then note that ^~ > holds, and 

P is bounded because of (4.9) and (2.36). We set P(-oo) := h m 7-s— 00 P(7)- 
Now we rewrite (2.34) as 

(Ki — AK)*P~ + ~P{K\ — AK) + (A*P + NK)*N- 1 (A*P + NK) 
- K*NK - C*C = 0, 

where 

(4.15) ^— E^EE*) -1 ^. 

1-7 

Noting that 

Ar = /- 7 S*(SS*)~ 1 S, 

lim K = 0, lim Ki = G, 

7— 00 7—^—00 

lim N' 1 =I-X*(EX*)- 1 Y,:=N ( _ oo) , 
7— >— 00 ' 

lim (K*iVK + C7*C) =^*(SS*)" 1 ^, 

7— 00 

where G = B — AE^EE*)" 1 ^ [see (A2)]. We obtain 

G*P(-oo) + P(-oo)G 

(4.16) _ 

+ P ( „ oo) AiV ( „ oo) A*P ( „ oo) - A*(EE*)-^ = 0. 

Moreover, we rewrite (4.16) as 

(G + AA^(_ 00 )A*P(_ 00 ))*P(_ oo) + P ( _ oo) (G + AiV^^A*?^)) 

- (P(_oc)AiV ( _ oo) A*P ( _ oo) + ^(EE*)" 1 ^) = 0. 
We consider 

and using the above relation, we can show 

/ e s(G+AJV ( _ oo) A*P ( _ oo) )*p 

Jo 

(4.17) x AA> ( _ oo) A*P ( _ oo) e s ( G+A ^(— ) A * ? (— ))rf s 

< --P(-oo)- 



. p t(G+AJV ( _ oo) A*P ( _ oo) )*p Np t(G+AAr { _ oo) A*P ( _ oo) ) 
■ - 1 (— 00) 
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Here we use P(-oc) — 0- Since G* is stable, 

(G* + (AiV ( „ oo) A*P ( _ oo) )*, (AT ( „ oo) A*P ( _ oo) )*) 

is stabilizable which means that (Nr 00 \A*Pr 00 \, G + AiV(_ 0O )A*P(_ oo )) is 
detectable. Therefore, noting that (A^.^)) 2 = Nr^) and that 

e «(G+A^(-cc)A*P ( _„ ) )'p ( _ M) ^ ( _ M)A *p ( _ M)ea (G+AiV ( _„ ) A'P ( _ oo) ) da 

is bounded because of (4.17), we see that G + AiV(_ 00 )A*P(_ 00 ) is stable 
(see [39], Proposition 3.2). Now noting that 

K\ — AK = G, -^-(K 1 -AK) = 0, 

cry 

NK = E*(EE*) -1 A, 4~iNK) = 0, 

cry 

K*NK + C*C = A*(Y l Z*y l A and — (K*NK + C*C) = 0. 

cry 

Then, by differentiating (4.14) with respect to 7, we obtain 

ffp ffp 

(Ki + AN- 1 A*PY ^— + —(K 1 + AN~ 1 A*P) 

cry cry 

(4.18) 

+ 7tt(A*P + ATin*£*(££*r 1 I!(A*P + NK) = 0. 

(1-7) 

Set (^)(_oo) = hm-y^-oo Then, sending 7 to —00 in (4.18), we see that 
(G + AjV^jA^oo))*^) 

+ f ^ (G + AA^^A'P^) = 0. 
V "7 / (_oo) 

Since G + AA r (_ 00 )A*P(_ 00 ) is stable, we see that 
(4.19) ( d Z) = . 



\<*r/<-co) 

Set 9(_oo) = hm 7 _ ) ._ 00 5(7). As for (7(7), sending 7 to —00 in (2.35), we have 
(G + AiV ( _ oo) A*P ( „ oo) )*g ( _ oo) + b*P hoo) 

-(^* + P ( _ oo) AS*)(SS*)- 1 (a-rl) = 0, 
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and so 



5(-oo) = i(G + AiV (oo) A*P(_ oo) )*}- 1 



x [(A* + P ( _ oo) AS*)(SS*)- x (a - rl) - ft'P^)]. 



Moreover, setting (S)(-oo) = lim^-oo J* we see by (4.12) that 



(G + AiV ( _ oo) A*P ( _ oo) r(^)^=0. 



Since G + AiV(_ 0O )A*P(_ oo ) is stable, we have 



dq\ 



(4.20) / =0. 

The present proposition is directly seen by using (4.13), (4.19) and (4.20). 
□ 
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